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ABSTRACT 



Using the Progress Measures Survey, data was collected from 
770 school-to-work (STW) partnerships in 34 states that encompassed almost 
36,000 secondary schools with nearly 18 million students, nearly 178,000 
employers, and almost 2,600 postsecondary institutions. Substantial gains 
were found in provision of STW opportunities in schools and modest gains in 
student participation. Regarding school-based learning activities, 78 percent 
of schools provided and 56 percent of students participated in activities 
using work-related curricula; 67 percent of schools provided and 39 percent 
of students participated in activities integrating academic and vocational 
curricula. Regarding work-based learning activities, 68 percent of schools 
provided and 8 percent of students participated in job shadowing; 39 percent 
of schools and 3 percent of students participated in mentoring; and 46 
percent of schools and 3 percent of students participated in internships. 
Overall business participation was slightly down. Teachers benefited from 
employer participation through internships. Data showed depth and breadth of 
STW activities and number of students engaged in activities are directly 
related to length of time the partnership has been in operation. The 
significant increase in percentage of partnerships receiving cash funding 
from outside sources indicated increased attention to alternative funding 
mechanisms. (Appendixes include the STW Opportunities Act 1994, Title IV; 
types of partnerships; definitions; and survey.) (YLB) 
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HIGHLIGHTS 



Each year, under the authority of Title IV, Section 402 of the School-to-Work 
Opportunities Act of 1994 (STWOA), the National School-to-Work Office reports the 
results of a performance measurement survey of school-to-work partnerships in all 
implementation states. This is the fourth report. 

The 38 states with implementation grants as of June 30, 1998 were asked to 
participate in the survey, which is conducted on a voluntary basis. A total of 35 states 
agreed to participate in this survey, and partnerships in 34 states provided data. These 34 
states comprise a total of 985 partnerships; 770 of these 985 partnerships (78 percent) 
completed Progress Measures Surveys. 

Indicators of System Development 

The 770 partnerships in the 34 states that provided Progress Measures Survey data 
report the following characteristics: 

• Collectively they encompass almost 36,000 schools, and nearly 18 million 
students attend those schools. 

• Approximately 55 percent of the schools are elementary, 20 percent are 
middle/junior high, 20 percent are secondary schools, and six percent are other 
grade-level configurations. 

• Nearly 178,000 private, public, and nonprofit employers are engaged in 
partnership activities, filling many diverse roles. 

• Almost 2,600 postsecondary institutions work with these partnerships — -48 
percent are two-year postsecondary institutions, 36 percent are four-year, seven 
percent are private career schools, and 1 0 percent are other types. 

Indicators of School and Student Participation 

The Progress Measures Survey asks for information about several specific school-to- 
work initiatives that are common across the implementation states. These are only a 
sampling of the range of activities that may be occurring in schools. As such, progress 
measures data undoubtedly underestimate the overall level of activity that is associated 
with the STWOA. 
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In 1997-98 there were substantial gains in the provision of school-to-work 
opportunities in secondary schools compared with 1996-97 and modest gains in student 
participation. 

• School-based learning activities: 

In 1997-98, 78 percent of secondary schools provided, and 56 percent of 
secondary students participated in, activities that used work-related curricula 
(compared to 68 percent of schools and 55 percent of students in 1996-97); 

In 1997-98, 67 percent of secondary schools provided, and 39 percent of 
secondary students participated in, activities that integrate academic and 
vocational curricula (compared to 55 percent of schools and 35 percent of 
students in 1996-97); and 

In 1997-98, 63 percent of secondary schools provided, and 16 percent of 
secondary students participated in, activities that connect work-based 
learning to integrated curricula (compared to 50 percent of schools and 13 
percent of students in 1996-97). 

• Work-based learning activities: 

In 1997-98, 68 percent of secondary schools provided, and eight percent of 
secondary students participated in, a job-shadowing experience (compared 
with 54 percent of schools and seven percent of students in 1996-97); 

In 1997-98, 39 percent of secondary schools provided, and three percent of 
secondary students participated in, mentoring activities (compared with 35 
percent of schools and two percent of students in 1996-97); and 

In 1997-98, 46 percent of secondary schools provided, and three percent of 
secondary students participated in, paid or unpaid internships (compared 
with 34 percent of schools and two percent of students in 1 996-97). 



Indicators of Employer Participation in School-to-work 

From July 1, 1997 to June 30, 1998, nearly 178,000 private, public, and nonprofit 
employers in the 770 reporting partnerships participated in some aspect of school-to- 
work. Over 154,000 of these were private businesses. The overall level of business 
participation was slightly down compared with 1996-97. However, the business 
commitment to work-based learning remains strong, as 61 percent of participating 
employers offered work-based learning opportunities to students. During the reporting 
period, private business establishments offered students more than 178,000 work-based 
learning positions. 

Teachers have also benefited from employer participation in school-to-work. In 
1997-98, over 14,000 private business establishments offered 17,000 teacher internships; 
the figures are about the same as last year. These internships offer teachers the opportunity 
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to gain new skills and design new ways of using their experiences to enrich instructional 
practice. 

Partnership Longevity 

Progress measures data show that the depth and breadth of school-to-work activities 
offered by local partnerships, and the number of students engaged in activities, are directly 
related to the length of time the partnership has been in operation. As one might expect, 
partnerships in existence for four or more years offer a broader range of school-to-work 
activities and serve larger numbers of students than partnerships that have existed for two 
years or less. This is particularly evident at the secondary school level, in both school- 
based and work-based activities. 

• While 1 6 percent of secondary schools in newer partnerships reported no school- 
based school-to-work activities, the percentage fell to only six percent in more 
established partnerships. 

• More mature partnerships are far more likely than newer partnerships to have 
built an employer network and put it to work for students: business 
establishments in more mature partnerships offered secondary students almost 
eight times the number of work-based learning opportunities available in newer 
partnerships. 

• Compared with teachers in newer partnerships, nearly five times as many 
teachers in mature partnerships had an internship experience. 

More mature partnerships were far more likely than newer partnerships to have a 
data-gathering infrastructure in place to enable them to collect information about their 
school-to-work initiatives. 



Infusion of Other Resources to Support School-to-Work Partnerships 

As federal funding under the School-to-Work Opportunities Act begins to diminish 
for many states and partnerships, the question of how school-to-work activities will be 
sustained in the future looms ever larger. Part of the answer lies in developing program 
strength. To the extent that states and local partnerships can show that participation in 
school-to-work makes a contribution to each student's educational experience, school-to- 
work concepts may find a place in the school curriculum, among employers, and in the 
larger community. Another part of the answer rests on developing a "post-federal funding" 
strategy. As required by the STWOA, all states are required to design strategies to sustain 
school-to-work beyond federal funding. The strategies may differ, but to the extent that 
states wish to sustain a partnership infrastructure (and not all states may choose to 
maintain an infrastructure), plans must be developed to generate a secure resource base. 
Clearly, many partnerships are working to expand their resource base: 
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• 71 percent of reporting partnerships have received at least some type of 
additional resources beyond federal funding. Approximately 68 percent have 
received public support of either funds or in-kind contributions; 45 percent have 
received private funds or in-kind contributions. 

• More than half of all partnerships (53 percent) report receiving some cash funding 
from outside sources (up from 41 percent in 1996-97); 56 percent report in-kind 
contributions from public entities; and 36 percent report receiving some in-kind 
contributions from private businesses. 

The significant increase in the percentage of partnerships receiving cash funding 
from outside sources indicates increased attention among states and partnerships to 
alternative funding mechanisms. No attempt was made to aggregate and report data on 
the amounts or value of resources received, but it does not appear to be substantial. 

Data Collection 

The myriad of logistical issues associated with data collection remains a challenge. 
Many partnerships still do not have the mechanisms necessary to gather data for the 
Progress Measures Survey. In particular, at the secondary level, most partnerships do not 
have the capacity to describe the demographic characteristics of students participating in 
particular school-to-work activities. At present, the capacity to collect and report these 
data depends heavily on the nature of existing data collection systems, the resources 
devoted to generating this information, and the unusual need to pool data not only from 
schools within partnerships, but from employers as well. Partnerships in operation for four 
or more years were more successful in collecting data for the Progress Measures Survey 
than partnerships in operation for less than four years. This suggests that, under any 
circumstances, it takes considerable time to design and implement an effective data 
gathering system. 

Looking Toward the Legacy 

As the STWOA moves toward sunset in October 2001, there is every reason to be 
impressed by the accomplishments achieved in a remarkably short period of time. States 
and local partnerships have shown demonstrable progress toward building systems and 
designing and implementing service strategies that are affecting the ways in which 
students are educated across the country. 

Ultimately, the real success of the Act will be determined by what happens beyond 
its sunset. The challenge rests with states and localities to find mechanisms that can ensure 
that the new ways of teaching and learning associated with school-to-work become part of 
the larger educational experience in every community. The important question is this: will 
state and local practitioners be able to sustain the momentum they have generated and 
continue their progress toward bringing school-to-work initiatives to scale? 
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Progress Measures Survey data can set the stage for discussions of the perceived 
value and utility of specific school-to-work activities by providing summaries of what is 
actually occurring at the state and local level. Progress measures provide a snapshot of the 
school-to-work system as it develops and matures, and in this sense, they represent an 
important backdrop to the larger evaluative process at the federal, state, and local levels. 
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INTRODUCTION 



Each year, under the authority of Title IV, Section 402 of the School-to-Work 
Opportunities Act (STWOA) of 1994, 1 the National School-to-Work Office (NSTWO) 
reports the results of a performance measurement survey of school-to-work partnerships in 
all implementation states. This is the fourth report. 2 

Progress Measures are a fundamental element of the school-to-work accountability 
system. As a matter of course, most states and local school-to-work partnerships annually 
gather and report progress measures and use these data, in conjunction with other 
information, to evaluate the success of their systems. 

Progress Measures, as described in the Act, have four objectives: 

• to respond to the mandate of Title IV, Section 402, which requires that the 
Secretaries of Education and Labor, in collaboration with the states, establish a 
system of performance measures for assessing progress in meeting the objectives 
of the Act; 

• to develop a common language around school-to-work, so that data will be 
comparable and of high quality across partnerships and across states; 

• to provide a framework within which states can design their own school-to-work 
data systems for program improvement purposes that range beyond the reporting 
function at the national level; and 

• to help state and local school-to-work practitioners develop the skills necessary to 
measure the success of their efforts. 

These objectives have been achieved, with varying degrees of success, given the very 
short time frame in which the progress measures system was designed and implemented. 
States and local partnerships have built progress measures data collection systems from 
the ground up — no small feat, given that few had ever gathered the kinds of information 
included in the Progress Measures Survey. 3 



^ee appendix A for the text of Title IV, Section 402, School-to-Work Opportunities Act of 1 994. 

2 Karen Levesque, Elliott Medrich, and Jennifer Giambattista School-to-Work Baseline Performance Measures: System 
Building in the Eight Implementation States (Washington, D.C.: National School-to-Work Office, 1995); Elliott A. 
Medrich, Jennifer Giambattista, and Ron Moskov\tz,School-to-Work Progress Measures: A Report to the National 
School-tO’Work Office for the Period of January 1, 1996-June 30, 1996 (Berkeley, CA: MPR Associates, Inc., 1997); and 
Elliott Medrich, Robin White, et al.,5c/?oo/-fo-Wor/: Progress Measures: A Report to the National School-to-Work Office 
for the Period July 1, 1996-June 30, 7 997(Washington, D.C: National School-to-Work Office, November 1998). 

3 For an extended analysis of the data-gathering process, see Elliott A. Medrich and Robin White/fie Data Dilemma: 

Putting Progress Measures to Work for Federal, State, and Local Decisionmakeri Berkeley, CA: MPR Associates, Inc., 

August 1999). 




14 



i 



Introduction 



For national reporting purposes, the five core indicators align with the data collection 
requirements described in Title IV, Section 402 of the Act. They are: 

(1) indicators of school-to-work systems development; 

(2) indicators of school and student participation; 

(3) indicators of employer participation; 

(4) student outcomes; and 

(5) information about resources beyond federal school-to-work funds. 

These core indicators are the focus of this report. The indicators are organized 
primarily around two of the three central areas of school-to-work as defined in the 
STWOA — school-based and work-based learning activities. The third component of 
school-to-work, "connecting" activities, which are designed to link school and work- 
based educational programs, requires more intensive investigation than was practical with 
the Progress Measures Survey. Research on the status of connecting activities in local 
partnerships was, therefore, left to the National evaluation. 

Progress measures complement other studies of school-to-work systems 
development, namely the National School-to-Work Evaluation. This independent 
evaluation is based on annual surveys of local partnerships. 4 It examines the extent to 
which states and local partnerships have created coherent school-to-work systems of 
connected and sustainable practices and programs and the extent to which students' 
experiences are changing as a result. Local partnership surveys are supplemented by case 
studies and student surveys in eight states. Together, Progress Measures and the National 
Evaluation promote a better understanding of how states and localities are tackling the 
challenges of building a school-to-work system that meets the needs of all students. 



Response Rates 

The 38 states with school-to-work implementation grants as of June 30, 1998 were 
invited to complete the Progress Measures Survey. Although survey response is voluntary, 5 
35 states agreed to participate. Partnerships in 34 of these states provided data. 6 The 34 
states comprise a total of 985 partnerships. A total of 770 partnerships, or 78 percent, 
completed surveys. Last year, the response rate was 81 percent. The lower response rate 
this year was largely due to the fact that three states in the final year of their school-to- 
work implementation grants had much lower participation rates than they had in the past. 
While the reasons for lower participation in these three states is not known with certainty, 
anecdotal evidence suggests that some partnerships were already in transition — working 
with less staffing and funding and with their responsibilities and activities dispersed among 



4 For the most recent report, see Alan M. Hershey, et al; Expanding Options for Students: Report to Congress on the 
National Evaluation of School-to-Work /mp/emen£at/on(Washington, D.C.: U.S. Department of Education, 1999). 

5 The Office of Management and Budget determined that participation in the Progress Measures Survey was to be 
voluntary on the part of states and local partnerships. 

6 Maine furnished no data and Minnesota, Nevada, and Ohio declined to participate. 
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other institutions. These conditions may have reduced their capacity to collect progress 
measures data and participate in the survey. 



Logistics of Data Collection and Data Quality Issues 

Progress measures data were collected with the assistance of state and local school- 
to-work directors and coordinators. For the most part, surveys were sent to local 
partnerships by state directors and returned to them. State directors, in turn, forwarded 
partnership surveys from their states to the National School-to-Work Office for data entry, 
prior to analysis by MPR Associates, Inc. 

On behalf of the National School-to-Work Office, MPR and the Academy for 
Educational Development examined the logistics of collecting data about school-to-work 
and the quality of these data . 7 One of the important findings of this research was that 
partnerships (and the schools from which they collect data) are, for the most part, very 
conservative in their reporting. Because partnerships are being asked to report data that 
have not been gathered before, many school and partnership staff indicated that it was 
extremely difficult to "count" the extent to which particular activities are occurring and 
the number of students participating in them. As a result, they tend to underreport the 
number of students taking part in school-to-work activities in their partnerships . 8 

This finding is extremely important in the context of progress measures. It suggests 
that the actual rates of school, student, and employer participation may be considerably 
higher than those reported in the Progress Measures Survey. Recognizing that this is the 
case, the data presented here may not fully represent the depth and breadth of school-to- 
work activities taking place in partnerships across the country. 



Outline of the Report 

This year's progress measures report is divided into seven main sections. Sections I 
through III are parallel to the last report and focus on three core indicators: systems 
development, school and student participation, and employer participation. 

Section IV takes a different look at the progress of partnerships, comparing 
participation levels in school-to-work based on the longevity of partnership funding. This 
is a particularly important set of comparisons; it provides a way of viewing progress 
toward sustaining school-to-work at the local level. 

Section V focuses on another of the core indicators — resources beyond federal 
school-to-work grants. This section examines the extent to which partnerships have been 
able to develop sources of funds to help support and sustain school-to-work efforts. 



7 Elliott Medrich and Robin White, The Data Dilemma. 

8 A major study of school-to-work progress measures in Florida reached a similar conclusion. See Frank Hammons, 
Florida School-to-Work Progress Measures Survey: Review of Data Collection and Reporting in Florida Partnehips 
(Miami: Florida International University, August 1999) 
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Section VI describes the capacity of partnerships to report specific types of data 
requested in the survey. 

Section VII offers a brief summary and conclusion, based on findings from the 
survey. It also specifies a series of questions raised in this analysis of progress measures 
data that deserve followup and further investigation. 



0 

ERIC 



4 



17 



